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INTRODUCTION 

The Technology Implementation and Support Section at Martin Marietta 
Astronautics Group Denver is tasked with software development analysis, 
data collection, software productivity improvement and developing and 
applying various computerized software tools and models. The 
computerized tools are parametric models that reflect actuals taken from 
our large data base of completed software development projects. Martin 
Marietta’s data base consists of over 300 completed projects and hundreds 
of cost estimating relationships (CERs) that are used in sizing, costing, 
scheduling and productivity improvement equations, studies, models and 
computerized tools. 

BACKGROUND 

Martin Marietta resolved in 1975 to establish a study effort to investigate 
the software development process and the understanding of how to plan, 
schedule, size, and estimate software. The outcome of this analysis was 
that management decided to develop a company-peculiar parametric 
software estimating cost, schedule, and manloading model. This 
parametric model was generated by using actual software development 
data collected over a number of years. Cost estimating relationships 
(CERs) were created, project and mix complexity factors were established, 
and independent variables were quantified. The result was data 
base-derived software estimating equations for assembly and high-order 
language software. These equations and our resulting software parametric 
models have been validated by comparing project sizing, labor actuals, and 
schedules with PCEM outputs and documenting the results. 
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DEVELOPMENT APPROACH 


During the early years of our data collection, analysis and model 
requirements generation activities it was decided that Martin Marietta's 
software parametric models would include the whole software 
development life cycle from systems requirements through systems test 
and provide budget and schedule outputs for the four software development 
organizations that contribute most to software development. These are: 

Systems Engineering, 

Software Engineering, 

Test Engineering, and 
Quality. 

Our data base collection approach consists of breaking software actuals 
out by class, type and language. 

Classes of software include : 

Manned flight 
Unmanned flight 
Avionics 

Shipboard/Submarine 

Ground 

Commercial 

Types of software are : 

Systems Software: Operating systems and executives. 

Support Software: Simulation, emulation, math models and 

diagnostic software 

Applications Software: Software that solves the customer's problems. 
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We collected sizing data by programming language. Our software sizing 
data base library consists of over 5 million Martin Marietta (Denver) 
developed source lines of code and over 4 million source lines of code 
developed by other software development companies and organizations. 

At Martin Marietta Denver, we are presently gathering detailed sizing 
information at the function level to provide additional inputs into our 
computerized sizing model. 

An example of this detailed data is a program of 13,830 SLOC (less 
comments), of which 9,678 (70%) was programmed in FORTRAN IV and 
4,152 SLOC was programmed in assembly language. There were also 1 ,434 
data statements. The sizing summary by computer program component 
(CPC) consists of the following: 


Data 

Total State- 


Function Name 

Assv 

HOL 

SLOC 

ments 

Executive/Qperatina System 

System Control 

102 

275 

377 

5 

Interrupt Handling 

655 

64 

719 

1 

Interprocessor communcations 

75 

139 

214 

0 

Initialization 

13 

35 

48 

1 

Operator Interface 

Menu display and automatic generation 

0 

1,003 

1,003 

8 

Operator prompting and error checking 

0 

899 

899 

4 

Tabular displays 

0 

485 

485 

51 

Graphic displays 

0 

34 

34 

0 

CRT Formatter 

0 

22 

22 

0 
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c) Data Base Manipulation 


Data base generation/regeneration 

0 

232 

323 

File management 

203 

94 

297 

Data storage and retrieval 

0 

248 

248 

Diagnostics. Fault Determination 

Sensor diagnostics 

104 

3,312 

3,416 

Memory diagnostics 

396 

1,610 

2,006 

CPU diagnostics 

2,510 

381 

2,891 

Hardware Interface 

Peripherals 

54 

0 

54 

Sensor Device 

40 

595 

635 

Format manipulation and information 
conversion 

0 

159 

159 


4,152 

9,678 

13,830 


The "interrupt handling" CPC function level breakout reflected these sizing 
numbers: 


Function Name 

Assv 

HOL 

Total 

SLQQ 

Real time interrupt handler (1) 

52 


52 

Enable/Disable subroutine 

5 


5 

Real time interrupt handler (II) 

10 


10 

Keyboard interrupt handler 

53 


53 

Keyboard handler subroutine 

0 

50 

50 

Put character 

0 

14 

14 

Disable interrupts routine 

8 


8 

Enable interrupts routine 

10 


10 
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0 

1,116 

9 


144 

60 

20 


0 

15 

0 


1,434 


Data 

State- 

ments 



MS Interrupt handler 

79 

79 

MSS Interrupt handler 

63 

63 

Real time interrupt handler 

81 

81 

STAR PIP interrupt handler 

67 

67 

ATOD data ready interrupt handler 

51 

51 

Deuce/STAR threshold data ready 


80 

interrupt handler 

80 


655 

64 719 


The above detailed sizing data along with the cost and schedule information 
by project provides the input for our detailed analysis and productivity 
improvement activities. 

PARAMETRIC MODELS 

The six models described in this paper are all PC-hosted models and trained 
users carry disks from job site to job site using available compatible PC 
computers located at the project facilities. These models provide a 
management capability that has not been available in the past, and there 
are no subscription costs or mainframe computer delays using these 
models. 

1) Software Parametric C ost Estimating Model (PCEM) 

This model provides a method for estimating the total budget, schedule 
and manloading for a software development activity. The model addresses 
all phases of software development from systems requirements through 
systems test. There are two versions of the PCEM model. Version 3.1 
reflects MIL-STD-490/483/1 679/1 521 A development. Version 4.0 reflects 
DOD-STD-2167 and Ada software development. 
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Description of the Parametric Model 


The data based utilized in the Software Parametric Cost Estimating 
Model (PCEM) consists of "in-house" and "outside" historical software 
development actuals collected from over 300 completed software 
development projects. 

The data based software projects were separated by "class" and "type" 
of software. Each class and type has a different complexity and different 
cost estimating relationships (CERs). 


Class of Software 






1) 

Manned space 

4) 

Shipboard and submarine 

2) 

Unmanned space 

5) 

Ground 

3) 

Avionics 

6) 

Commercial 

Type of Software 



1) 

Systems Software 



2) 

Applications Software 



3) 

Support Software 



Independent Variables 




Several independent variables were investigated and the four which 
were selected and incorporated into the model are summarized below: 

1 • Lines of Code - The PCEM accepts either source lines of code or 
machine instructions (object instructions). The amount of functional 
decomposition performed prior to arriving at a sizing estimate is very 
important. A great deal of time and analysis is put into reviewing the 
decomposition so that a good determination of sizing accuracy can be 
resolved before we input sizing numbers into the PCEM. 
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2. Project Complexity - Project complexity consists of 1 4 factors which 
reflect how well the customer problem is understood and how prepared 
the contractor is to respond to solving his problem. The factors are 
weighted and all 14 must be addressed. 

1) Requirements Definition 

2) Documentation Requirements 

3) Experience of Personnel 

4) Experience with Equipment/System 

5) Amount of Travel Required 

6) Language Complexity 

7) Interfaces 


8) Man Interaction 

9) Development Environment 

10) Timing and Criticality 

11) New or Existing Software 

1 2) Reliability of Test Hardware 

13) Testability of Software 

14) Operational Hardware 
Constraints 


3. Mix Complexity - The software mix complexity is applied after 

software sizing has been accomplished. A hundred percent of the 
identified software lines of code are distributed across the eight mix 
elements. 


The eight elements of mix complexity describe fractions of the total 
number of source or object instructions, identified by the software 
engineer. 


1) Mathematics 

2) String Manipulation 

3) Diagnostics, Support Software 

4) Data Storage and Retrieval 


5) On-line Communcations 

6) Realtime Command and Control 

7) Man-machine Interaction 

8) Systems software 


4. Schedule - PCEM determines the optimum schedule and establishes 
dates for software milestones. The optimum schedule is defined as 
that period of time when the software can be developed for the least 
amount of dollars. Costs will increase if the schedule is accelerated, 
or if it is stretched out beyond the optimum schedule. 


With the four independent variables defined along with class and type 
information, the PCEM can arrive at a total software cost and schedule 
estimate. 
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Organizations Included in the PCEM Output: 


The PCEM cost equations provide estimates of budget and schedule for 
the following three software development organizations: 

1) Systems Engineering 

2) Software Engineering 

3) Software Test Engineering 

With the information on source or object lines of code, project 
complexity, mix complexity and user-supplied schedule, the PCEM 
computerized model can now arrive at the number of manmonths and the 
schedule required for each of the three software development 
organizations. 

The equations used in the computerized model are arrived at by a 
multiple regression methodology assessing and analyzing the collected data 
base information. 


Assembly Language and High Order Language CERs 


Development Costs 


Equation: 

Where 


Y = a (x t b i) • (x 2 b 2) ■ (x 3 b 3) ■ (x 4 b 4) 

Y = Total Number of Manhours (165 hours = 1 M/M) 
x 1 = Estimated Number of Source Lines Code 

x 2 = Estimated Project Complexity 
x 3 = Estimated Mix Complexity 
x 4 = Schedule 
a = Constant 
b 1 , b 2 , b 3 , b 4 = exponents 
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Rnrinet and Schedule Information is p r ovide d bV POEM til both 
MU -RTD-49D/483/1 679/1 521 A and for DO D - STD - 2 167 Developments : 


Version 3.1 (MIL-STD-490/483/1 679/1 521 A) 


bKH OMhl oun 

1 REQUIREMENTS 

DESIGN 

0006 

T6ST 


Systems 

Req(s 

Reqts 

Alloc 

Software 

Reqls 

Pret 

Design 

Oetail 

Design 

Code 

Checkout 

Unit 

Test 

Integration 
PQT EOT 

System 

Test 


Version 4.0 (DOD-STD-2167) 


SPR SRR SDR SSH 

1 RPO( IIRFMFNTS 

D6SIGN 

jry • * 

COCG 

TEST 


Systems 

Concept 

Sys 

s/w 

Reqls 

Anal 

Software 

Reqts 

Anal 

Pret 

Design 

Oetait 

Design 

Code 

Unit 

Test 

CSC 

Informal 

Test 

CSC! 

Formal 

Test 

System 

Integration 

Test 


The computerized PCEM model provides a labor estimate in manmonths, 
broken out by the phases and subphases of software development. The 
model identifies an optimum schedule and provides manloading information 
for each calendar month required for software development. The manmonth 
estimates are divided between the three organizations that have software 
development responsibility. 


Example Version 3.1 : 

CALfiWR MONTHS 


Sys Engr 
S/W engr 
Tesl Erwgr 
Total 


t 

2 

a 

4 

s 

15 

7 

8 

9 

10 

11 

12 

SPR 

SRR 

SOR 

PC 

>R 

COR 


TRR 

TRR 



AR 

Re< 


25 

. 











i » 

Design 3J3 













Cc 


_ 











i 

CkouL2. 












1 

Unit ZT 

i 










1 1 

2.25 TOT 













Sirs 

Tesl 











2. 

Si 

3.0 

3.0 

3.0 

1.5 

1.0 

.5 

.5 

.5 

.5 

.5 

.5 

.S 

2.S 

3.5 

4.5 

7.0 

8.5 

10.0 

9.S 

8.0 

6.5 

4.S 

3.0 

2.5 

.5 

.5 

.5 

.S 

.5 

s 

l .0 

1.5 

2.0 

3.0 

3.S 

3.0 

6 

7 

8 

9 

l 0 

1 1 

1 1 

1 0 

9 

8 

7 

6 


15.0 M/M 

70.0 M/M 

17.0 M/M 

102.0 M/M 
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2. Maintenance Model 


The computerized "In Scope" maintenance model was recently 
validated, and became a Parametric Cost Estimating Model (PCEM) output 
during the first quarter of 1 988. The parametric maintenance model is an 
historical data based derived tool designed to assist users in estimating 
the cost of In Scope maintenance efforts over a few calendar months or 
over several years. The software maintenance model output includes those 
efforts related to maintaining the baseline software configuration through 
error correction and fine tuning activities. 

3. Performance Measurement Model 

This state-of-the-art software development performance 
measurement tool was developed during 1988, and permits independent 
assessment of on-going software development project performance. The 
user establishes a performance structure which consists of a list of 
documentation, design reviews, and milestones that the model is going to 
use to track software development performance. The model provides a 
measurement of the performance level based on actuals with respect to 
budget and schedule and estimates a set of "to complete" budget numbers 
and calendar months for the identified project. During the course of the 
development the model identifies where the project is performing at either 
above or below a 1 00 percent capability. 

4. Sizing Model 

The software sizing model is a standalone model which is presently 
undergoing verification and validation testing, but in the very near future it 
will become a parametric cost estimating model (PCEM) output. The sizing 
model provides software development engineers with a new concept 
computerized functionality software sizing capability. The model gives the 
user a tool to create software development functional decompositions. 

Once the decomposition is established, the model helps the user create 
lower level functional decompositions based on whether the software 
functional element represents a processing task, an input task, or an output 
task. Software functionality menus containing generic lists allow the user 
to indicate functional elements that are components of the software 
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systems to be developed. As the user identifies software elements, 
FORTRAN source lines of code estimates are provided by the sizing model. 
The model also includes an estimating algorithm for data statements 
sizing. 

5. Risk Analysis Simulatio n Tool (RAST) 

RAST is an interactive computer-based application model that 
provides a technique for performing quantitative software risk assessment. 

A major feature of the RAST model is the ability to apply statistics to 
assess cost risk of proposals and on-going projects. The RAST provides the 
capability to add, subtract, multiply, and divide Monte Carlo derived 
distributions and constants. 

6. Software Architecture Sizing and Estimating Tool (SASET1 

This is a new computerized software cost estimating, scheduling and 
functional sizing model developed for the naval Center for Cost Analysis in 
Washington, D.C. The SASET model is a forward-chainging rule-based 
expert system utilizing a hierarchically structured knowledge data base to 
provide sizing values, optimal development schedules and various 
associated manloading outputs depending on complexity and other factors, 
the model is divided in four separate tiers: Tier I, Project Emulation; Tier 
II, Sizing; Tier III, Complexity; and Tier IV, Maintenance. The model has 
recently gone through verification and validation testing and the Air Force, 
along with the Navy, has just recently (September 1988) provided 
additional dollars to add a calibration enhancement. 

ADA 


Martin Marietta Denver has been actively involved with the Ada 
language since its inception. We particpated in the public evaluation of the 
Red, Blue, Yellow and Green languages before the Green language was 
selected as Ada in 1979. Over 200 employees have attended our in-house 
software engineering Ada training course, and over 200,000 SLOC in Ada 
have been generated by Martin Marietta students and by engineers on 
projects using the Ada language. In 1981 Martin purchased the NYU Ada/Ed 
interpreter for the VAX computer and the demand for a higher performance 


W. Cheadle 
Martin Marietta 
1 1 of 29 


implementation led to the purchase of a Telesoft/Ada compiler for the 
VAX/VMS in 1 983. Martin Marietta also purchased a validated Rolm Ada 
Compiler and a Data General Eclipse MV 8000 II computer in 1983. C 3 I 
software developed for a large system started in July 1984 and required 
rehosting Ada software from the Data General onto a VAX 1 1/780 computer. 
During 1987 and 1988 Martin Marietta Denver has won three large command 
and control projects requiring the use of Ada as the software development 
language. 

CONCLUSIONS 

Martin Marietta has one of the largest software development data bases in 
the country and has been involved in software development data collection, 
analysis and model building since 1975. Our analysis experts have 
conducted costing, sizing, scheduling and development management studies 
on the Ada language for the past several years and have provided new 
parametric models for Ada management costing and scheduling. Our models 
and techniques are project tested and geared to providing top management 
with the tools and resources needed for accurately sizing, costing and 
scheduling Ada projects and for doing performance measurement on these 
same projects as they move through the software development process. 



W. Cheadle 
Martin Marietta 
12 of 29 


THE VIEWGRAPH MATERIALS 


FOR THE 

W. CHEADLE PRESENTATION FOLLOW 



CD 

21 




CD 


T 


<*» 


Ul 



CE 

T 


LU 


CL 

o 

DC 

O 

CO 

O 

5 



Si 


„ n X " 
z DC 5 a DC 

- I !“ z m Sf 

I t > 1 > 

O^Z^Z 
. < Ul < Q III 
^2020.0 


• • 
>* 

m 

Q 

Ul 

£ 

Ul 

CO 

UJ 

DC 

O. 



ORDINAL PAGE IS 
OF POOR QUALITY 


3 


W. Cheadle 
Martin Marietta 
15 of 29 


LKLCi-Uu vo rAliil 


uLALLA WOT FILMED 


MC E, I K INTENTIONALLY BUNK 



¥* PARAMETRIC MODELS 


CO 


LU 




o 




o 




z: 




o 




CL 




h- 




LU 

• 

• 


z: 

ro 



< 

CL 

o 

z 

o 


< 

CO 

0£ 

CO 

CL 


CL 

ULI 

LU 


O 

> 

> 


LU 

z 

Z 


> 

LU 

LU 



o 

O 


o' 

Q. 

a. 


LU 


*w» 



_l 

_l 



LU 

LU 


LU 

a 

O 


00 

o 

o 


< 

Z 

z 


CD 

o 

z 

o 

z 


< 

f- 

H- 


h- 

< 

< 


< 

z 

z 


O 


H- 



CO 

CO 

1 

CO 

LU 

LU 

LU 

< 

CO 

h“ 

CO 

O 

O 

1— 

o 

o 

z 

h- 

o 

u 

LU 

LU 

u 

o 

CJ 

CL 

a: 

cl 

z 

<■ 

< 

h- 

LU 

H 

LU 

z 

TL 

z 

z 

LU 

ft. 

Z 

< 

cl 

< 

CL 

i 

z 

1 — 

< 

< 

< 

CL 

Q. 

Cl 

z 





1— 




CO 




< 

_ 1 



CL 

LU 




a 




o 



o 

Z 


-J 

o 

H- 

Z 

LU 

z 


LU 

Q 

O 

z 

z 

O 

LU 

CL 


z 

o 

1— 

< 

3 



-J 

CO 


p 

z> 

< 


< 

z 

LU 

Z 


o 

CO 

LU 

CJ 

z 


LU 

CO 

_J 

LU 

Q 

H- 

Z 

CO 

> 

< 

o 

_ 

-J 

z 

z 

o 

Cl 

< 

z 

o 

LL 

CD 

z 

o 

\ 

< 


(SI 

CJ 

CO 

LU 


CO 


a. 

CO 

CJ 

o' 


< 

n 


Cheadle 
rtin Marietta 
16 of 29 


SOFTWARE ARCHITECTURE SIZING AND ESTIMATING TOOL 
(SASET) 


DATA BASE MARTIN MARIETTA ASTRONAUTICS GROUP 
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Organizations Included in Software Development. 
Percent of Development Life Cycle. 

Source Lines of Code: 24 projects = 4,282,098 SLOC. 
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HOURS PER SOURCE LINE OF CODE 



2.24 hours per SLOC 
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WHAT CONSTITUTES AN ADA SOURCE LINE OF CODE? 
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STUDY OF SOFTWARE PRODUCTS 


H. Sayani, Advanced System Technology Corporation 
J. Hihn, Jet Propulsion Laboratory 
R. LaBaugh, Martin Marietta 


pr&oi r 


ivDT FILMED 



